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Field of the Invention 

This invention pertains generally to modems, codecs, and methods for their 
operation, and more particularly to gateways and other interfaces containing multiple 
modem and/or codec resources. 

Background of the Invention 

With the explosive growth of the World Wide Web, the race to deliver high- 
bandwidth access to the consumer is on. Competing bandwidth-delivery schemes 
include conventional analog modems, "digital" modems, integrated services digital 
networks (ISDN), asymmetrical digital subscriber line (ADSL) and its siblings, 
referred to collectively as xDSL, cable modems, and satellite network links. 

For practical and historical reasons, companies offering data network access 
(e.g., network service providers, or "NSPs") today typically rely on at least some 
portion of the public system telephone network (PSTN) to deliver their product. 
Analog modems, digital modems, ISDN, and xDSL all utilize the consumer's "local 
loop", i.e., the copper wire twisted pairs(s) connecting the consumer's residence or 
business with a central office or branch. An analog modem connection may also 
connect to the ISP through a local analog loop. The fastest analog modems utilize a 
"half-digital" connection, i.e., the ISP connects to the PSTN digitally while each of 
their customers utilizes an analog connection. And with ISDN and xDSL, the 
connection utilizing the local loop is all digital. 
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A typical NSP may provide simultaneous data network access to hundreds or 
even thousands of customers through a single gateway connected to the PSTN. Such 
a gateway usually will not comprise a bank of discrete modems each connected to a 
phone line, but rather a group of modem cards, each containing multiple processors, 
all connected to a high-speed data bus. The high-speed data bus connects to the 
PSTN through an access concentrator. The access concentrator typically 'transmits 
and receives signals to and from the PSTN over multiple Tl or El connections, and 
performs format conversion between the Tl/El format and the high-speed data bus 
format. 

Because the quality of local loop connections can vary widely, sophisticated 
modems "train" to a best possible connect speed for each connection by a process of 
line probing. For instance, a "half-digital" modem connection utilizing the V.90 
specification tests line transmission characteristics for each of the 256 possible 8-bit 
digital symbols during training. Training allows the modem pair to determine a 
subset of these symbols that can be received reliably by the analog end of that 
communication channel. The training process typically takes at least several seconds 
for each connection, and the results of the process are used to configure an internal 
state for each modem in the modem pair. 

Summary of the Invention 

During operation, each modem in a multiple-modem gateway trains to a 
unique set of operating parameters for its current connection. If that modem fails, or 
is inadvertently or purposefully taken out of service by the NSP, the connection being 
handled by that modem is simply dropped by the gateway. A dropped customer may 
spend several minutes reconnecting to the gateway through a different modem and 
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retracing their steps through the network. In some cases, customers may lose part of 
their work or be uncertain as to whether commands they were performing at the time 
of disconnect executed. A customer dropped while in the middle of executing a large 
on-line stock order, for instance, may even miss an opportunity to have the order 
5 execute at a desired price. As gateways continue to appear with the capability to 
emulate greater numbers of modems on a single circuit card, or even on a single 
digital signal processor, the possibility of a subsystem failure affecting a large number 
of customers raises a serious reliability concern for network service providers. 

The present invention seeks to enhance the operation of network gateways, 

% 10 and data communication interfaces generally, by safeguarding against dropped 

connections. Generally, this is accomplished in the present invention by providing 

y3 redundancy for modems and/or other data-handling resources such as fax transceivers, 

voice codecs, video codecs, and larger resources implementing multiple modems, 
transceivers, or codecs. Each of these resources develops an internal resource state, 

rS 15 e.g., related to communication channel characteristics and/or data characteristics, 

ff| during a data connection. A network gateway utilizing the present invention provides 

redundancy for a given resource by saving critical resource state information, 
normally found only in the resource itself, in a separate resource state memory. If a 
condition, such as an out-of-service condition, is detected for a resource, state 
20 information for that resource, along with the data stream for the resource, is directed 
to available, functional resources. Resources receiving redirected data attempt to 
recreate a state that allows the data connection to continue without call loss. 

In one aspect of the invention, a data communication interface is disclosed. 
The interface comprises a data bus, first and second data-handling resources, a 
25 resource state memory, and a data-handling resource controller. Both data-handling 
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resources are connectable to the data bus. The resource state memory is configured to 
store state information from the first data-handling resource. State information stored 
in the resource state memory is loadable into the second data-handling resource. The 
data-handling resource controller responds to conditions requiring that a data 
connection be switched off of the first data-handling resource by initiating switchover 
of the connection to the second data-handling resource. 

Typically, the data communication interface will comprise 7V+1 resources, 
where N>\ . In such a situation, TV of the resources may be backed up by one 
additional resource if each of the N resources saves state information in the resource 
state memory. The additional resource may be strictly a spare, or it may be used 
under peak loading, in which case no redundancy may exist at peak loading. 

The present invention applies to data communication interface subsystems 
also. For instance, a data communication interface may comprise multiple modem 
cards, each having several digital signal processors emulating modems. Each card 
may provide on-card redundancy for its individual processors. 

In another aspect of the invention, a modem is disclosed. This modem writes 
internal state information to an external location while servicing a modem connection. 
Preferably, the modem also has the capability to read state information from an 
external location and configure itself to begin servicing an existing modem 
connection. This second capability may also exist in a modem that does not have the 
capability to save internal state information. 

In a further aspect of the invention, a method of operating a data 
communication interface having multiple data-handling resources is disclosed. This 
method comprises saving internal state information from an active data-handling 
resource in a location separate from the data-handling resource. The active data- 
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handling resource is monitored for conditions, such as resource fault conditions, 
requiring removal of an active data connection from the resource. If and when such 
conditions occur, the saved internal state information for the active data connection is 
loaded into a second data-handling resource having the capacity to handle the data 
5 connection, and data-handling for the data connection is transferred to the second 
data-handling resource. Preferably, the identity of the second data-handling resource 
is determined at the time of the fault, based on system loading or other statistics. 

Brief Description of the Drawing 

The invention may be best understood by reading the disclosure with reference 
to the following figures, wherein: 

Figure 1 illustrates a data communication interface according to one 
embodiment of the invention; 

Figure 2 illustrates a data communication interface according to a second 
embodiment of the invention; 

Figure 3 shows a multiple-modem subsystem according to yet another 
embodiment of the present invention; 

Figure 4 shows a data network gateway configured according to an 
embodiment of the invention; and 

Figure 5 illustrates a possible memory map for a state memory in the 
embodiment of Figure 3. 

Detailed Description of the Preferred Embodiments 

The present invention generally applies to data communication interfaces and 
25 their operation. Data communication interfaces that may benefit from the present 
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invention share a common characteristic — the existence of multiple data-handling 
resources, within the interface, that develop state information regarding 
communication channel and/or data-handling characteristics affecting a particular data 
connection. One common data communication interface is a data network gateway 
that connects PSTN customers to, e.g., a packet-switched data network that uses IP 
addressing. For a given data connection, such a gateway looks like a modem on the 
PSTN side and looks like an IP node on the data network side. Similar interfaces may 
exist in systems servicing cable modem customers, satellite modem customers, or 
customers using other phone-line based data access systems. Data communication 
interfaces may also allow multiple users to remotely access a specific system, rather 
than a network. 

The following terms have the following meanings for purposes of this 
disclosure. A data-handling resource provides data transformation for one or more 
data connections in a data communication interface. Some examples of data-handling 
resources are modems, fax translators, voice encoders and decoders, and video coders 
and decoders. Internal state information is data transformation and communication 
information, specific to a given data connection, that a data-handling resource 
develops over the course of a connection. A modem sends and/or receives digital data 
in a modulated format compatible with a desired communications medium, but an 
A/D or D/A converter needed to complete the connection may exist separate from the 
modem. 

The ultimate goal of the present invention is to provide a mechanism for a 
timely and effective transfer of data handling between resources. The transfer should 
be timely for at least two reasons: first, significant amounts of data may be lost if the 
transfer is not timely, making recovery difficult; second, and perhaps more important, 
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a break in communication must be short enough that the equipment or person at the 
opposite end of the connection will not perceive a dropped connection and abandon 
the connection. In order for the transfer to be effective, the newly-connected resource 
must pick up a connection "speaking the same language" as the disconnected 
5 resource. Each of these concepts will be explored in turn. 

The switchover of data-handling resources contemplated by the present 
invention may appear in two contexts. In the first context, the "scheduled" 
switchover, the first resource continues to handle data for a connection until 
commanded to halt. In the second context, the switchover is unscheduled. In this 

1 0 case, the data communication interface must detect that the first data-handling 

resource has failed or is failing. This will usually involve a break in data-handling for 
an active connection, which the second resource must clean up. 
Timely Scheduled Switchovers 

In the scheduled switchover context, a data communication interface initiates a 

1 5 transfer of a data connection away from a resource that is still effectively handling the 
connection. For instance, a technician may desire to replace a modem board, and may 
initiate a command to transfer active connections away from that board first. Or, 
system load dynamics may change such that resource loading becomes unbalanced, 
and the system may initiate transfers to equalize loading. In either case, adequate 

20 time exists to bring a new resource up to speed before initiating a switchover. 

Preferably, system architecture allows data from a given data connection to 
flow simultaneously to two resources (if not, the switchover can, e.g., use 
unscheduled switchover techniques). The new resource can thus begin seeing the data 
that the current resource is processing before it actually becomes the primary resource 

25 for the connection. 
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Timely Unscheduled Switchovers 

In the unscheduled switchover context, a data communication interface 
initiates a transfer of a data connection away from a resource after determining that 
the resource is no longer effectively handling the connection. This may happen 
because a resource has been physically disconnected from the interface, lost power, 
locked up, or merely broken. Because such an occurrence cannot be predicted in 
advance, the interface must rely on the last state information saved by the resource 
before the failure. The new resource assigned to the connection must attempt to patch 
up the discontinuity that occurred due to the failure. The resource must also begin 
handling the connection before the equipment or person at the other end of the 
connection perceives a drop and terminates the connection. For instance, after 700 
milliseconds many modems will consider a connection lost and terminate it — the new 
resource must send some signal within this time frame to prevent a drop. 
Effective Switchover Techniques 

In order to be effective, switchover generally need not be transparent. The 
degree to which data loss can be tolerated depends on the application. At the very 
least, the new resource must at least initially follow the same protocol as the old 
resource. Preferably, this will also include using consistent frame numbering, 
consistent error coding, and consistent compression techniques. 
System Design Alternatives 

Figure 1 illustrates a data communication interface 20 according to one 
embodiment of the present invention. Data bus 22 carries data for one or more data 
connections. Data-handling resources 24 and 26 both connect to data bus 22 and 
communicate with resource controller 28. Data-handling resources 24 and 26 also 
connect to resource state memory 30. 
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Normal operation of the system is as follows. Data-handling resource 24 
participates in new data connections through data bus 22. As resource 24 develops 
internal state information about the operation of a connection, it saves some of this 
information to resource state memory 30. Meanwhile, resource controller 28 remains 
ready to respond to conditions that warrant removal of the data connection from 
resource 24. Data-handling resource 26 sits ready to take over connections as 
required. 

When a connection is to be switched from resource 24 to resource 26, resource 
controller 28 signals resource 26. As systems benefiting from the invention have the 
capability for multiple simultaneous data connections, the signal should contain 
information appropriate to allow resource 26 to ascertain how to access data 
connection information from both resource state memory 30 and data bus 22. Data- 
handling resource 26 loads state information (i.e., the information previously saved by 
resource 24 for the data connection) from resource state memory 30 and configures 
itself according to this information. Resource 26 accesses data bus 22 to serve the 
data connection previously served by resource 24. 

With reference to the embodiment of Figure 2, several additional aspects of 
the present invention will now be described. Figure 2 shows a data communication 
interface 44 having two primary data-handling resources 34, 36 connected to data bus 
22. In addition, backup resource 40 connects to data bus 22. Backup resource 40 also 
contains a memory 42. Resources 34, 36, 40, and resource controller 38 are 
connected by control bus 46. This embodiment illustrates an architecture where a 
single resource provides redundancy for two (or more) primary resources. This 
embodiment further illustrates that the backup resource may be a specialized resource, 
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e.g., one that also handles state-saving for the primary resources and does not process 
data from data bus 22 during normal system operation. 

In operation, resources 34 and 36 are responsible for placing state information 
on control bus 46. Backup resource 40 saves the state information placed on control 
bus 46 by each resource 34, 36 in memory 42. In the event of a failure in either 
resource 34 or resource 36, resource controller 38 instructs backup resource 40 to take 
over data connections impaired by the failure. Backup resource 40 accesses state 
information pertaining to the failed resource and attempts to continue the impaired 
connections. 

A Redundant Subsystem 

Figure 3 illustrates several additional operational principles, as well as the 
application of the invention to a data communication interface subsystem. Subsystem 
50 comprises a modem card for a network interface. TDM (time-division multiplexed) 
bus 52, which has the capacity to carry at least several hundred 8 kHz 8-bit PCM data 
streams, provides a first external interface for the card. IP data bus 60 provides a 
second external interface for card 50. Control bus 62 provides a third external 
interface for the card. 

Modem card 50 contains 17 processors — resource controller 56 (a general 
purpose microprocessor), and 16 digital signal processors DSP0 through DSP 15 that 
function as modem resources. Each digital signal processor has throughput sufficient 
to emulate digital data-handling for one or more modems. Resource controller 56 
controls overall card operation and handles off-card communications through busses 
60 and 62. 

If operated as a prior art data communication interface, modem card 50 would 
receive system commands over control bus 62, e.g., instructing resource controller 56 
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to handle a call at a specific time slot on TDM bus 52. Resource controller 56 would 
hand processing for the call off to one of digital signal processors DSPO through 
DSP15, for example, DSPO. DSPO would access PCM data from TDM bus 52 at the 
specified time slot, demodulate the PCM data, and transform the data into frames or 
packets compatible with an IP format. DSPO sends transformed data frames via card 
bus 54 to resource controller 56, which routes the data as packets onto IP bus 60. If 
DSPO malfunctioned, the call would simply be dropped. 

When operated as an embodiment of the present invention, modem card 50 
provides redundancy for each of DSPO through DSP 15 without incorporating a 
dedicated backup DSP. Each DSP on modem card 50 provides state information for 
its current data connections, through card bus 54, to resource controller 56 at periodic 
intervals. Controller 56 stores state information in memory 58. If controller 56 
detects a failure in one of DSPs DSPO through DSP 15, it searches for an available 
functional DSP resource from among DSPO through DSP 15. Active data connections 
from the failed resource are then redirected to the alternate resource. Resource 
controller 56 uploads state information pertaining to the now- failed resource into the 
alternate resource and instructs the resource to pick up the data connection at the 
appropriate TDM time slot. 

The architecture and operation of card 50 provide several desirable features. 
During peak loading, each DSP resource may be utilized to maximize throughput, i.e., 
no resource must sit idle in order to provide backup capability (although if all 
functional channels are utilized, the card will temporarily lose internal backup 
capability). Card 50 also provides flexibility, in that any available resource may be 
used to back up any other resource on the card. This flexibility extends to distributing 
data connections from a single failed resource among several available or partial ly- 
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available resources. In addition, multiple failed resources can be tolerated. Finally, 
DSP switchover operation on the card is virtually transparent to an overall system 
using the card. 

Modem card 50 can also provide external redundancy for each DSP. If, at the 
time of a DSP failure, no available functional resource exists on the card, state 
information for data connections assigned to the failed resource may be sent over 
control bus 62 to other parts of the system. 
State-Saving Considerations 

The level of data saved in memory 58 may be varied, either dynamically or to 
a preset level. For example, when system loading is low, sufficient throughput may 
exist to allow a more complete state picture to be saved. During periods of higher 
loading, the state picture may be limited to the minimum necessary to avoid dropping 
a connection. In any particular system, bandwidth, memory size, and the difficulty of 
recovering from a potential loss of data at resource switchover must be traded off to 
arrive at an appropriate level of state-saving. 

By way of illustration, suppose that a new modem call is routed to card 50 and 
specifically modem DSP4. In handling the call, DSP4 first determines the capabilities 
of the modem on the .other end of the modem call during handshaking. If the modems 
decide upon a common standard such as V.32bis, V.34, or V.90, all deployed by the 
International Telecommunications Union (ITU), during handshaking the modems will 
probe the communication channel to determine a reliable set of symbols to be used for 
communication. Generally, the set chosen will be a function of channel noise, 
channel non-linearities, and the robustness of the modem at the other end of the line. 
The symbol set, connect speed, error control information, and connection standard are 
saved to memory 58 once the connection is established. 
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Standards such as V.34 and V.90 provide mechanisms for continuous line 
probing, and may adjust symbol set and connect speed as the connection progresses. 
These adjustments are also noted in memory 58 as they occur. 

Modem connections typically utilize a data compression standard, such as 
5 V.42bis, to compress data where possible before transmission. Such standards 

generally build and maintain a codebook at both ends of the connection. Where such 
a standard is in use, it is preferable that the codebook values also be saved in memory 
58. As an option, a modem attempting to pick up an established connection may 
request to the opposite end that it reset codebooks for both transmit and receive, e.g., 
O io using the C-INIT command of V.42bis. 

[Tr Modems typically employ link control. Basically, link control involves a 

protocol for acknowledging the receipt of frames. If a frame is received with no 
errors, the receiver transmits an ACK signal back to the sender. If a frame is received 
with errors, a NAK signal is sent back to the sender, who then retransmits the frame. 
15 If neither signal is received by the sender within a preset time of it sending a frame, it 
assumes that the frame was lost and it resends it. Preferably, DSP4 would save link 
control information to memory 58 also. 

DSP4 may modify its normal link control operation in order to function 
according to an embodiment of the invention saving link control information in state 
20 memory 58. For instance, DSP4 may delay sending ACK signals for a frame until it 
has fully processed and disposed of the frame, and noted the frame receipt in state 
memory 58. DSP4 may also note frames for which it has sent ACK or NAK signals 
in memory 58. 

As the modem communicating with DSP4 will also be receiving frames and 
25 sending ACK and NAK signals, it is preferable that state memory 58 also contain data 
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necessary to respond to these signals. To provide this capability DSP4 saves frames 
that it transmits in state memory 58, along with their transmission time. It marks 
these frames as successfully transmitted once an ACK signal for the frame is received, 
and the frames may then be overwritten in state memory 58. 
5 Figure 5 illustrates one suggested memory map for state memory 58. Each 

DSP is assigned a portion of memory map 100, and is responsible for keeping these 
contents current (alternatively, currency and map management may be handled by 
controller 56). For instance, DSPO may be assigned a first portion of map 100, which 
may be partitioned into several fields as shown in detail map 102. Although this list 
y 10 is not exhaustive, nor would all fields apply to every possible communication 

!~ standard (indeed, different partitioning of detail map 102 may be used for different 

Cm 

yj standards), the map arranges data such that a second resource may read it and 

S| ascertain the current state of the resource. 

The "Receive" section of detail map 102 may list recent activity. Generally, 

=== 

hf 15 unless a frame has been ACK'd prior to modem failure, a substituted modem can 
^ request retransmission. Therefore, a list of the last received frames ACK'd and 

NAK'd should allow a substituted modem to know which frames are needed upon 

switchover. 

The "Transmit" section of detail map 102 may contain a series of records each 
20 representing a frame. Records may show the frame number, the last transmit time if it 
has been transmitted, whether the frame has been ACK'd or NAK'd, and the data 
contained in the frame. Preferably, these records are kept current such that a 
substituted modem may respond to requests from a paired modem. 

One way in which resource controller 56 may discover modem failures is to 
25 monitor DSP4's state-saving actions. If DSP4 stops saving state, or acts in an 
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undefined manner, resource controller 56 commands an available resource, e.g., 
DSP8, to take over DSP4's data connection. DSP8 then loads state information 
pertaining to DSP4's data connection from memory 58, and begins monitoring the 
appropriate TDM time slot on bus 52. DSP8 configures its internal registers to reflect 
5 the symbol set, connect speed, error control information, and connection standard 
used on the data connection. DSP8 loads compression codebook information, or 
otherwise suspends or restarts data compression. DSP8 loads pending frames (i.e., 
those sent by DSP4 but not acknowledged) from state memory 58, and begins 
responding to ACK and NAK signals from the opposite end of the connection. 
10 As DSP8 begins to receive frames from TDM bus 52, it compares the frame 

numbers to the receive link control information saved by DSP4 prior to its failure. 
From this comparison, DSP 8 determines intermediate frames that were not 
successfully processed by DSP4 prior to its failure, and sends NAK signals for those 
frames. 

15 As an alternative, if a "retrain" command is available under the 

communication protocol utilized for the data connection, DSP8 may merely advise its 
paired modem to retrain or revert to a known state. This command may be 
particularly advantageous where memory or time limitations prohibit the saving of a 
complete state picture. 

20 For most systems however, state saving will require a small amount of 

memory and a negligible percentage of the processing power of a modem resource. 
For instance, a modem resource may execute 20 million-instructions-per-second 
(MIPS) in emulating a V.34 modem having a maximum transmitted data rate of 
33,600 bits per second, or 4,200 bytes per second. If one percent of the resource's 20 
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MIPS were dedicated to saving state, 200,000 instructions, or 47 instructions per byte 
transmitted, would be available to save state. 
A Double-Redundant System 

Figure 4 shows modem card 50 connected in a data communication interface 
68. Interface 68 provides a termination point for modem connections to PSTN 84, 
and resembles one or more IP nodes to IP network 86. Interface 68 comprises four 
identical modem cards 50, 70, 72, and 74. TDM data bus 52 on card 50 is an 
extension of TDM data bus 76, which connects to each modem card in similar fashion 
and is also interfaced to PSTN 84 (typically through an access concentrator, not 
shown). Card 50' s IP data bus 60, along with the EP data busses of cards 70, 72, and 
74 all connect via bus 78 to host processor 88. A control bus 82 also connects to each 
card, including control bus 62 on card 50. Host processor 88 comprises a host 
memory 90. 

Data-handling redundancy for interface 68 is provided both at the card level 
and at the system level. For example, in addition to saving state information in 
memory 58, card 50 communicates state information over bus 78 or 82 to host 
processor 88, for storage in host memory 90. If card 50 malfunctions or is removed, 
state information pertaining to card 50 's active connections may be transferred by 
host processor 88 to one or more of cards 70, 72, and 74. 

Other data-handling resources may also be provided with call-continuation 
redundancy via the method of the invention. Each will require state information 
saving appropriate to the type of resource. Some resources, such as audio and video 
codecs, may be more tolerant of missing data than a modem, and may thus require 
minimal state memory. 
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By way of example, the following provides examples of potentially savable 
state information for an audio codec. Audio codecs encode and decode digital audio 
streams using specific coding standards, such as G.723 or G.729, both also 
promulgated by ITU. Coding standards generally specify the coded bit rate and 
5 format of encoded frames. Other parameters, such as frame size, may be varied by 
the user. Each frame is assigned a sequence number, which is used to estimate frame 
transmission delay and re-order frames received out of sequence. Some codecs also 
employ predictive coding, wherein the bit rate of a frame is reduced by not 
transmitting information that can be predicted from preceding frames. Thus, helpful 
= 1 0 information that may be stored in a codec resource memory would include the 

applicable transmission standard, bit rate, and frame size, sequence numbers for 
^ recently transmitted and received frames, play out delay estimates, current values of 

SJ predictive coefficients, and perhaps received-but-not-yet-played frames. Note that 

H 5 predictive coefficients can be relearned, and missing frames generally result in a short 

!=d 1 5 garbled section of speech, such that codec switchover with minimal state information 
^ generally produces only momentary degradation. 

The teachings of the present invention may be applied to other data-handling 
resources, e.g., those that modulate, demodulate, encode, and/or decode data in a data 
communication interface. After reading this disclosure, one of ordinary skill in the 
20 data communications art will recognize that a wide range of design latitude exists for 
implementing the invention. For example, who saves internal state information and 
how it gets saved are design considerations. In particular, in some instances frame 
data may be taken directly off of a bus, and need not necessarily be explicitly saved 
by a resource before being stored in a state memory. Timing considerations for 
25 initializing a resource to another resource's state are also best left to an individual 
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designer. Other modifications to the disclosed embodiments will be obvious to those 
of ordinary skill in the art upon reading this disclosure, and are intended to fall within 
the scope of the invention as claimed. 



Docket #2705-39 



18 



